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Abstract 

We  have  developed  a  simple  multi  function  vision 
system  for  3D  data  acquisition  for  a  wide  range  of 
applications  in  robotics  and  automation.  The  system 
uses  one  CCD  video  camera  and  an  active  directed 
laser  light  source  based  on  a  direct  drive  spherical 
pointing  motor  (SPM).  The  anatomy  of  the  system 
and  algorithms  used  are  described.  System  calibra¬ 
tion  methods  and  measurements  of  accuracy  of  the 
outputs  are  presented.  A  list  of  applications  is  shown. 

1  Introduction 

The  three  main  approaches  known  for  3D  data  ac¬ 
quisition  are  stereo  vision,  laser  range-finder  and  vi¬ 
sion  system  with  structured  light.  Each  of  these  ap¬ 
proaches  has  its  own  tradeoffs.  In  our  system,  we  em¬ 
phasize  real  time  performance,  simplicity,  reliability, 
low  cost  and  adaptability  to  a  wide  range  of  applica¬ 
tions. 

From  this  point  of  view,  the  conventional  ap¬ 
proaches  have  significant  drawbacks.  Stereo  vision 
systems  are  either  computationally  expensive  or  have 
been  found  to  be  unreliable  in  experiments  [5]  [2]  [4]. 
Laser  range  finders  either  acquire  only  one  dimen¬ 
sional  distance  data  or  are  complex  and  expensive. 
Furthermore,  combining  range  data  with  an  image  is 
still  an  open  research  problem.  Vision  systems  utiliz¬ 
ing  structured  light  require  a  straight  line  or  special 
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constant  regular  structure  covering  the  entire  field  of 
view  [5]. 

Our  system  is  capable  of  randomly  accessing  points 
within  the  field  of  view  as  well  as  emulating  different 
kinds  of  structured  light  patterns.  This  flexibility  al¬ 
lows  the  system  to  work  in  real  time  simply  and  inex¬ 
pensively. 

2  System  Anatomy 

The  hardware  in  our  system  consists  of  a  single 
CCD  video  camera  for  image  acquisition  and  a  di¬ 
rect  drive  spherical  pointing  motor  (SPM)  [12]  carrying 
a  diode  laser  (see  figure  1)  for  generating  structured 
light  patterns.  A  computer  workstation  coordinates 
the  vision  system  through  a  video  frame  grabber  and 
a  serial  line  connected  to  a  microcontroller  that  drives 
the  SPM.  The  system  in  this  configuration  can  be  used 
for  3D  data  acquisition  and  as  visual  feedback  for  SPM 
calibration.  Figure  2  shows  a  schematic  of  the  hard¬ 
ware  elements  in  our  system. 

3  Algorithm  for  3D  Data  Acquisition 

First,  a  target  point  on  the  camera  image  is  se¬ 
lected.  This  can  be  done  either  by  specifying  a  pixel 
coordinate  or  by  locating  a  mark  that  has  been  placed 
in  view  of  the  camera. 

Once  the  goal  target  has  been  specified,  the  next 
task  is  to  point  the  SPM  so  that  the  laser  beam’s  spot 
lies  on  the  target  point.  This  is  accomplished  by  it¬ 
eratively  locating  the  center  of  the  laser  spot  in  the 
video  image  and  determining  the  difference  between 
the  spot  location  and  the  goal  target.  If  the  difference 
is  not  zero  then  the  SPM  is  commanded  to  move  to¬ 
ward  the  target  and  the  process  is  repeated  until  the 
laser  spot  reaches  the  goal  target. 


Figure  1:  This  prototype  Spherical  Pointing  Motor 
(SPM),  built  by  Fred  Hansen,  has  a  65  degree  coni¬ 
cal  workspace.  The  rotor  limb  contains  a  cylindrical 
permanent  magnet  which  is  moved  by  applying  cur¬ 
rents  to  the  horizontal  and  vertical  sets  of  coils.  The 
position  of  the  limb  is  measured  by  four  Hall  effect 
sensors  located  on  the  back  plane  of  the  SPM.  The 
laser  is  inside  the  alumninum  limb. 
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Figure  2:  Schematic  diagram  depicting  the  hardware 
used  in  our  investigation. 


Figure  3:  Coordinate  frames  used  in  triangulation  cal¬ 
culations. 


Once  the  goal  target  is  reached,  the  orientation  of 
the  laser  beam  is  calculated  from  Hall  effect  sensor 
data  in  order  to  perform  triangulation.  Figure  3  shows 
the  coordinate  frames  used  in  the  triangulation  calcu¬ 
lations.  The  following  equations  are  used  for  triagula- 
tion: 
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The  conventions  used  in  the  above  equations  are 
the  same  as  in  figure  3  with  the  following  additions: 


Bspm  -  distance  between  SPM  center  ans  SPM  Hall 
sensor  plane 

focus  -  TV-camera  lens  focus 

YSpm_Cu  -  SPM  back  end  coordinate  in  Hall  Sensor 
units 


Yob_pixei  -  Y  coordinate  of  object  in  image  pixels 

OCFspm_y  -  translation  coefficient  from  Yaxis  Hall 
units  to  metric  sizes 

COFtv_y  -  translation  coefficient  from  Yaxis  image 
pixels  to  metric  sizes 
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4  Calibration 

Accurate  3D  data  acquisition  based  on  triangula¬ 
tion  requires  accurate  data  for  the  geometry  of  the 
system  elements.  The  relative  geometry  of  the  cam¬ 
era,  SPM  and  screen  are  easy  to  measure,  however 
the  orientation  of  the  SPM  rotor  limb  is  not  easily  de¬ 
rived  from  the  arbitrary  Hall  effect  sensor  units  that 
the  SPM  controller  returns.  Hence  the  most  impor¬ 
tant  calibration  problem  involves  accurately  mapping 
Hall  effect  sensor  units  into  the  pan  and  tilt  angles  of 
the  rotor. 

In  our  experimental  setup,  only  a  small  portion  of 
the  SPM’s  workspace  falls  within  the  field  of  view  of 
the  camera.  One  good  consequence  of  this  is  that  the 
region  of  Hall  sensor  values  visible  to  the  camera  is 
relatively  linear  and  can  be  fit  well  with  segments  of 
linear  functions. 

4.1  Camera  Calibration 

TV  camera  calibration  is  performed  by  locating  the 
laser  spot  on  a  test  screen  with  special  marks  on  it  [1], 
Based  on  the  known  geometry  of  the  camera,  SPM 
and  screen,  angle  position  of  each  point  in  the  field  of 
view  can  be  determined. 

4.2  SPM  Calibration 

Calibrating  the  SPM  presents  some  difficulties.  The 
Hall  effect  sensors  used  in  the  SPM  for  feeback  have  a 
relatively  linear  response  as  a  function  of  magnetic  flux 
through  the  sensor,  but  the  value  of  the  flux  is  sub¬ 
stantially  non-linear.  Functions  for  the  magnet  flux 
exist,  but  are  quite  complicated  [8]  [9]  [10]. 

To  calibrate  the  SPM,  a  flat  screen  is  placed  a 
known  distance  from  the  SPM  and  camera  in  order  to 
derive  the  SPM  limb  angles  by  triangulation.  To  cali¬ 
brate  the  SPM  along  the  field  of  view  of  the  camera,  we 
constructed  a  piecewise  linear  function  mapping  Hall 
effect  sensor  units  into  angles.  The  boundary  points 
for  each  linear  piece  were  chosen  by  the  following  pro¬ 
cedure:  first  we  choose  several  test  points  in  the  cam¬ 
era  image  and  then  performed  lpt  sequences  [3]  [6]  [11] 
(Note:  these  sequences  have  special  uniformity  distri¬ 
bution  properties  so  we  can  choose  additional  points 
with  out  repeating). 

For  several  points  within  one  linear  segment,  we 
calculate  the  distance  between  the  true  head  position 
(determined  via  known  system  geometry  and  the  lo¬ 
cation  of  the  laser  beam  in  TV  image)  and  the  lin¬ 
ear  segment.  If  the  distance  falls  outside  a  tolerace 
of  0.01  degrees  then  either  the  linear  coefficients  are 
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Figure  4:  One  linear  segment  of  the  calibration  func¬ 
tion  showing  a  comparison  between  actual  SPM  posi¬ 
tion  and  the  linear  approximation 

adjusted  or  a  new  boundary  point  is  chosen  and  the 
linear  segment  is  split  in  two.  The  above  process  is 
then  repeated  on  each  new  linear  piece. 


5  Experimental  Results 

We  conducted  our  tests  in  our  indoor  Laboratory 
with  ambient  light  and  surrounding  objects.  Under 
these  conditions,  we  found  the  working  range  of  our 
0.1  mW  laser  to  be  from  0.5  to  10  m.  The  accuracy  of 
the  experimental  3D  data  acquisition  fell  within  0-5% 
of  the  measured  distance.  This  accuracy  was  achieve 
using  a  9  segment  piece-wise  linear  calibration  cov¬ 
ering  the  entire  image  the  TV  camera  field  of  view 
(about  15  degrees).  An  example  of  a  linear  calibra¬ 
tion  function  within  one  segment  is  shown  in  figure 
4. 

We  investigated  both  horizontal  and  vertical  rel¬ 
ative  displacement  between  TV  camera  and  light 
source.  We  found  that  vertical  displacement  yields 
results  of  higher  accuracy. 

5.1  Error  Analysis 

There  are  several  sources  of  error  in  our  setup.  Fig¬ 
ure  5  shows  the  distribution  of  errors  contributing  to 
an  overall  3%  error  found  in  measuring  z  distance. 

The  most  significant  source  of  error  is  the  video 
digitizer  used  for  image  acquisition.  The  flaw  is  not  in 
the  resolution  of  the  digitizer  but  rather  in  its  inability 
to  consistently  start  sampling  from  the  same  scan  line 
of  each  video  frame.  This  results  in  an  uncertainty  in 
the  location  of  the  center  of  the  image  by  a  few  pixels. 
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Figure  5:  Breakdown  of  error  contributions  to  overall 
3%  error  in  Z  distance  calculations  along  the  Y  direc¬ 
tion 
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Figure  6:  A  comparison  between  Hall  sensor  records 
on  X  and  Y  axis. 


The  next  most  significant  source  of  error  is  in  the 
Hall  effect  sensor  readings.  Figure  6  shows  the  fluc¬ 
tuation  in  the  X  axis  and  Y  axis  Hall  effect  sensor 
readings. 

Compared  to  the  digitizer  and  the  Hall  effect  sen¬ 
sors,  all  other  sources  of  error  (see  figure  5)  contribute 
relatively  little  to  the  overall  error. 


6  Conclusions  and  Further  Work 

In  our  error  analysis  (see  figure  5),  we  found  that 
the  largest  error  contributions  were  due  to  inaccuracies 
in  the  video  digitizer  and  in  reading  the  Hall  effect 
sensors.  This  suggests  that  our  system  could  attain 
significantly  improved  precision  with  only  moderately 
better  hardware. 

The  characteristics  of  the  multi-function  vision 
system  system  make  it  appropriate  for  use  in  self- 
contained  mobile  robots,  manipulators,  and  rapid  pro¬ 
totyping  for  industry,  medicine  and  the  arts. 

The  current  technology  in  direct  drive  actuators 
[13]  suggests  that  our  system  can  be  scaled  to  small 
sizes.  In  fact  SPMs  of  sub-millimeter  size  have  already 
been  fabricated  [7]. 

We  plan  to  construct  a  Micro  Random- Access  Laser 
Rangefinder  based  on  the  SPM.  This  new  device  will 
allow  a  surgeon  to  obtain  range  information  to  objects 
visible  in  micro  TV  camera  images  tramsmitted  from 
inside  the  body  during  microsurgery.  Often  surgeons 
find  the  TV  images  confounding  due  to  lack  of  depth 
information,  but  if  we  place  the  SPM  with  a  micro- 
laser  near  the  camera,  then  we  can  point  the  laser  at 
any  “pixel”  in  the  camera  image  and  determine  the 
3-dimensional  coordinates  of  that  point. 

We  will  continue  to  investigate  and  improve  our 
system  in  several  ways.  We  plan  to  improve  the  video 
and  SPM  sensor  subsystems  in  order  to  reduce  our 
most  significant  sources  of  error.  We  plan  to  apply 
improved  SPM  control  algorithms  that  we  have  devel¬ 
oped  to  increase  the  3D  sampling  rate  of  the  system 
and  to  simplify  calibration. 

We  are  concurrently  investigating  several  other  ap¬ 
plications  for  the  SPM.  We  are  developing  an  under¬ 
graduate  curriculum  in  Robotics  and  Real-Time  Con¬ 
trol  using  the  SPM  and  building  Ada  cross-compilers 
based  on  the  GNAT  compiler  technology. 

The  contents  of  the  course  we  propose  will  integrate 
both  hardware  and  software  topics,  and  include  sub¬ 
stantial  programming  experiments.  Each  course  unit 
combines  some  aspect  of  embedded  system  design  and 
programming  with  some  features  of  Ada9X,  in  the  con¬ 
text  of  a  specific  experiment  with  one  of  the  robotics 
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devices,  many  involving  the  SPM.  A  final  project  is 
the  implementation  of  a  complex  set  of  behaviors  by 
one  or  more  devices,  which  can  include  a  vision  sensor 
SPM  3D  data  aquisition  subsystem. 

The  low  cost  of  the  actuators  is  expected  to  have  a 
significant  impact  on  robotics  education,  because  they 
can  be  disseminated  widely  to  universities  and  techni¬ 
cal  schools. 
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